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ABSTRACT 

--The  well-known  perturbational  duality  theory  for  convex  optimization  is 
refined  to  handle  directly,  in  locally  convex  Hausdorff  spaces,  problems 
involving  noncoercive  convex  functionals  together  with  unbounded  densely 
defined  linear  operators  or,  more  generally,  convex  processes.  The  theory 
presented  includes  conjugacy,  recession,  and  t-subdif ferential  formulas  for 
the  two  fundamental  pairs  of  dual  operations  and  also  includes  systematic 
treatment  of  e-solutions. 
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SIGNIFICANCE  AND  EXPLANATION 


Dual  variational  principles,  which  arise  classically  in  physics  and 
mechanics  and  typically  involve  partial  differential  operators,  usually 
correspond  to  dual  pairs  of  constrained  convex  optimization  problems  in 
various  infinite-dimensional  function  space  settings.  Constrained 
optimization  denotes  the  search  for  an  optimum,  say  a  minimum,  of  some  given 
criterion  functional  over  a  set  of  candidate  solutions  which  satisfy  given 
side  conditions,  or  constraints.  Convex  problems  form  the  simplest  class  of 
nonlinear  problems.  Dual  pairs  of  convex  optimization  problems  are  nonlinear 
generalizations  of  the  familiar,  widely  useful  dual  pairs  of  linear 
programming  problems.  Dual  pairs  of  constrained  convex  optimization  problems 
arise  also  in  fields  other  than  physics  and  mechanics,  including  mathematical 
economics,  operations  research,  management  science,  many  subfields  of 
engineering,  and  mathematics  itself. 

The  mathematical  model  for  constrained  convex  optimization  problems  known 
as  perturbational  duality  theory,  developed  some  10  to  15  years  ago,  provides 
a  nearly  complete  mathematical  treatment  of  those  basic  situations  which 
involve  "nice"  (i.e.  coercive)  convex  functionals  and  "nice"  (i.e.  bounded) 
linear  operators.  Much  less  developed  is  the  treatment  for  problems  involving 
noncoercive  functionals  and  unbounded  operators  only  densely  defined.  Even 
less  understood  are  problems  involving  more  complicated  operators  called 
convex  processes,  which  in  general  are  multivalued  and  not  even  densely 
defined,  and  which  are  important  in  problems  from,  e.g.,  mathematical 
economics. 

This  paper  presents  a  mathematical  theory,  valid  in  very  general  spaces, 
for  dual  pairs  of  constrained  convex  optimization  problems  involving 
noncoercive  functionals  and  unbounded  linear  operators  or,  more  generally, 
convex  processes.  It  constitutes  a  fundamental  refinement  of  the  well-known 
perturbational  duality  model  cited  above.  Systematic  treatment  of  approximate 
optimal  solutions  is  also  provided,  rendering  the  model  more  amenable  to 
further,  numerical  analysis. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


QUASI STABLE  PARAMETRIC  OPTIMIZATION  WITHOUT  COMPACT  LEVEL  SETS 


L.  McLinden 

It  is  well  known  that  a  lower  semicontinuous  (l.s.c.)  function 
#  :  X  +  (-»,»]  ,  $  %  00 ,  achieves  a  finite  infimum  if  the  sets  {x|$(x)  <  a}, 

a  e  R,  are  compact.  Convex  conjugate  duality  establishes  that,  if  ♦  is  convex, 

* 

a  dual  sufficient  condition  for  such  compactness  is  that  the  conjugate  function  $ 
be  continuous  at  0.  Much  work  in  constrained  optimization  has  dealt  with 
elaborating  and  implementing  this  result  (see  References).  The  present  work  is 
rooted  in  the  following  generalization:  a  direct  sufficient  condition  for  such  a 
convex  ♦  to  achieve  a  finite  infimum  is  that  (i)  (x|$(x)  <  a},  at  e  R,  are  locally 
compact  and  (ii)  $  is  constant  along  the  whole  line  generated  by  any  direction  in 
which  ♦  does  not  eventually  increase.  Here  we  present  theorems  embodying  this 
result  in  strengthened,  augmented  form  tailored  to  basic  structure  occurring  widely 
in  constrained  optimization.  They  go  well  beyond  the  closest  counterparts  now 
available  (including,  notably,  [5],  [10],  [9],  [1,  Ch.  14]). 

A  word  on  notation.  All  spaces  are  locally  convex  Hausdorff  topological  vector 
spaces  over  R;  X,  V  are  paired  in  duality,  as  are  U,  Y.  For  a  multifunction 
T  from  Z  into  W  (i.e.  T  :  Z  ♦  2W)  ,  G(T)  :=  {(z,w)|w  e  T(z)}, 

D  (T )  {z  |  T(  z )  *  tf},  R(T )  {w|3z,w  e  T(z)}.  For  T  and  any  ♦  :  Z  ♦  l-*,00], 

define  T$  on  W  by  (T$)  ( w)  :  =  inf  {$(  z  )  |  z  e  T  1  ( w)  }  ,  with  inf  16  :=  00  •  For  $ 

l.s.c.  proper  convex,  $0  +  (z)  :  =  sup{X  ^($(z  +  Xz)  -  #(z))|0  <  X  <°°}  for  any 
fixed  z  e  dom  $  :=  {z|#(z)  <  °°}  ,  and  if  Z  is  paired  in  duality  with  W, 

$  (w)  :=  sup  { <  z ,  w>  -  $(z)L.  €  z)  and  GO^fc)  :=  {(z,w)|<t>  (w)  <  G  +  <z,w  >  -  ( z } } 

for  each  fixed  e  e  [O,00).  We  abbreviate  "weakly  locally  compact"  by  w.l.c. 


Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-80-C-004 1 ,  and  the 
National  Science  Foundation  under  Grant  No.  MCS-81026P4. 


Let  A  be  a 


* 

THEOREM  I.  Let  h  be  l.s.c.  proper  convex  on  X  with  k  :=  h  . 
densely  defined  linear  operator  from  X  into  U  with  closed  graph  and  adjoint 
B.  Define  kB  on  Y  by  (kB)(y)  :=  k(By)  if  y  e  D(B)  and  :=  00  if  y  0  D(B). 
Assume  (i)  D( A)  n  dom  h  i3  nonempty  and  w.l.c.  and  (ii)  x  e  A^fO),  hO+(x)  <  0 
==>  hO+(-x)  <  0.  Then  (1)  (kB)*(u)  =  (Ah)(u)  >  and  (2)  (Ah)0+(u)  = 

(A(h0+))(u)  >  -00,  with  both  infima  on  the  right  attained  whenever  not  00 
vacuously.  For  any  e  €  [0,°°),  y  €  d£(Ah)(u)  <==>  u  e  3£(kB)(y)  <==> 
y  e  D(B) ,  u  e  A3^k( By ) . 

Notice  (1)  ==>  £  ?  R( B )  O  dom  k.  Further,  by  (1),  (2)  is  equivalent  to: 


<u,y>  - 


yeB  dom  k 


sup  <x,v>  >  -°°  , 
vedom  k 


with  the  infimum  attained  whenever  u  e  R(A).  If  (ii)  holds  in  the  form 

"x  e  A-1(0),  h0+(x)  <  0  ==>  x  =  0,"  the  infimum  problems  on  the  right  of  (1),  (2), 

(2*)  have  weakly  compact  e-approximate  solution  sets  for  all  e  e  [O,00). 

"Quasi stable"  in  the  title  denotes  the  fact  that,  whenever  (Ah)(u)  <  00  in  (1),  one 
can  prove  the  u.s.c.  proper  concave  q(v)  :=  inf{h(x)  -  <x,v>|x  e  A  ^(u)}  on  V  is 
Mackey  quasicontinuous  [5]  and  that  the  "inf”  defining  q  is  attained  for  all  v 
(e.g.,  v  =  0)  in  the  Mackey  relative  interior  of  {v|q(v)  >  -*} •  Counterparts  of 
these  remarks  apply  below. 

THEOREM  II.  For  j  =  let  fj  be  l.s.c.  proper  convex  on  X  with 

gj  :=  fj.  Assume  (i)  dom  f2,...*dom  fm  are  w.l.c.  and  (ii)  x-j  +  .  . .  +  xm  -  0 , 
f10+(x1)  +  ...  +  fm0+(xm)  <  0  ==>  f10+(-x1)  +  ...  +  fm0+(-xm)  <  0.  Then  (1) 

(g,  +  ...  +  gm ) * ( x )  =  (f,  □  ...  □  fm)(x>  >  and  (2)  (f,  □  ...  □  fm)0+(x)  = 

(f,0+  □  ...  □  fm0+)(x)  >  -00,  with  both  infima  on  the  right  attained.  [□  denotes 
inf-convolution.]  For  any  e  €  [O,00),  v  e  3e(f.j  □  □  fm)(x)  <==>  x  e  3£(g^  +  ... 

+  *n)(v)  <==>  x  e  U  {3e  9l(v>  +  +  3e  Vv)l£j  >  °'  e^  +  +  £m  =  e}‘ 

1  m  J 

THEOREM  III.  Let  h  be  l.s.c.  proper  convex  on  X  with  k  :=  h  .  Let  A  be 
a  closed  convex  process  [8,  §39]  from  X  into  U  (i.e.  G(A)  is  a  nonempty  closed 
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convex  cone)  with  adjoint  A*  from  Y  into  V  given  by  v  e  A*{y)  <==>  <u,y>  < 
<x,v>  for  all  u  e  A(x).  Assume  (i)  ^  f  D ( A )  n  dom  h  and  dom  h  is  w.l.c.  and 
(ii)  x  e  A_1(0),  hO+(x)  <  0  ==>  hO+(-x)  <  0.  Then,  for  B  :=  A*-1,  (1)  (Bk)*(u) 

“  (Ah)(u)  >  -•  and  (2)  (Ah)0+(u)  “  (A(h0+))(u)  >  ~°°,  with  both  infima  on  the 

right  attained  whenever  not  ®  vacuously.  Further,  y  e  S^fAhMu)  <==> 

u  6  3  ( Bk )  ( y )  <-»>  [  ax  e  A_1(u)  3v  e  B-1(y)  such  that  <u,y>  >  <x,v>, 

O 

v  e  3  h(x)].  For  any  e,6  e  [0,®)  and  (v,y)  e  G(B)  with  k(v)  <  <5  +  (Bk)(y)  <  00 , 
o 

y  e  3£(Ah)(u)  <“>  u  6  3e(Bk)(y)  — >  [u  e  R{ A )  and  Hx  6  A*1^)  3ot  >  0  3B  >  0 

such  that  a  +  6  *  e  +  <$ ,  <u,y>  >  <x,v>  -6,  x  €  3ak(v)]  *»>  u  e  <~> 

y  e  3^+5(Ah) (u) . 

THEOREM  IV.  Let  F  be  l.s.c.  proper  convex  on  X  x  u.  Let  A  be  a  linear 
transformation  from  X  into  U  with  either  A  continuous  or  A  densely  defined 

with  closed  graph.  In  the  latter  case,  assume  [F(*,u)  %  00  “>  F(*,u)  somewhere 

*  * 

continuous],  or  dually,  [F  (v,*)  ?  00  =*>  F  (v,-)  somewhere  continuous].  Assume 
(i)  (x  €  D(A)  |au,  F{ x , u )  <  *}  is  nonempty  and  w.l.c.  and  (ii)  x  e  D( A) , 

F0+  ( x, Ax)  <  0  =•=>  F0+(-x,-Ax)  <  0.  Then 

f  i 

-•  <  min  F( x ,u  +  Ax)  *  sup#  l-F  (A  y,-y)  -  <u,y>)  =  :  p(u), 
x€D ( A )  y€D( A  ) 

<  min  sup  <  ( x  ,u)  ,  ( v, -y  )>  =  sup  <u,-y>  =  p0*(u)  , 
xeD(A)  (y,v)eA  yeAo 

where  A  :=  {(y,v)|y  e  D ( A* ) ,  F*(A*y,-y)  <  •} ,  A^  :=  {y!(y,0)  e  A}.  For  any 

^  ^  A  A  A  A  ^ 

e  e  [0,»),  -y  e  <==>  y  e  Arg  c-max{-F  (A  y,-y)  -  <u,y>|y  e  D(A  )}  <==> 

[y  6  D(A* )  and  3x  e  D( A)  such  that  (A*y,-y)  e  3£F(x,u  +  Ax)],  and  any  such  x 

A  A  A 

belongs  to  Arg  e-min{F(x,u  +  Ax)|x  6  D( A ) } •  If  also  (iii)  Aq  is  w.l.c.  then,  for 
each  u  satisfying  [y  e  D(A  ),  F  0+(A  y,-y)  +  <u,y>  <  0  ==>  F*0+(-A  y,y)  -  <u,y> 

<  0],  one  has  p(u)  €  R  and  the  "sup"  defining  p(u)  is  actually  "max." 

THEOREM  V.  Let  H  be  closed  proper  convex-concave  [9]  on  X  x  y,  put 
F(x,u)  :*  sup{H(x,y)  -  <u,y>|y  6  v) ,  and  assume  this  F  together  with  A  satisfy 
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the  hypotheses  of  Theorem  IV.  Then 


-®  <  min  sup{H(x,y)  -  <Ax,y>  -  <u,y>) 
xeD(A)  y 


sup#  inf {H(x,y )  -  <x,A*y>  -  <u,y>}  =:  p(u)  , 

yeD(A  )  x 


—00 


<  min 

xpn f  a) 


sup  < (x,u) , (v,-y )>  = 


where  A  ;=  {(y,v)|y  e  D( A* ) ,  G(y,v  +  A*y)  >  -  ®)  ,  Aq  :=  {y|(y,0)  e  A}  for  G(y,v) 
:=  inf{H(x,y)  -  <x,v>|x  e  x}.  For  any  e  e  [0,®),  -y  €  3£p(u)  <==> 

A  A  A  ^  A  A 

y  e  Arg  e-max  inf{H(x,y)  -  <x,A  y>  -  <u,y>) 

A  * 

y€D( A  )  x 

[  y  €  D(A*)  and  3x  e  D(A)  such  that 


<~> 


^  A  A  A  A  ^ 

(*)  sup{H(x,y)  -  <Ax,y>  -  <u,y>)  <  e  +  inf{H(x,y)  -  <x,A  y>  -  <u,y>) 

A  A 

y  x 


<==>  y  e  D  ( A* )  and  3x  e  D  ( A )  with  ( ** )  (A*y,-y)  e  9£F(x,u  +  Ax) 

If  also  (iii)  A  is  w.l.c.  then,  for  each  u  such  that 
o 

^  {y | H(x, • )0+(y )  -  <u  +  Ax,y>  >  0}  is  a  subspace, 

xecnD(A) 


where  C  :=  {x|h(x,«)  is  somewhere  finite)  and  H(x,*)(y)  :=  use  H(x#*)(y),  one 
has  p ( u )  e  R  and  the  "sup”  defining  p(u)  is  actually  "max." 

Relation  (*)  (resp.  (**))  for  e  =  0  can  be  regarded  as  the  abstract 
Hamiltonian  (resp.  Euler-Lagrange )  system  for  the  setting  of  Theorems  V ,  IV  (cf. 

[1]  ). 

Main  outlines  of  proof.  (I)  follows  from  (IV)  by  replacing  A  by  -A  and 
putting  F(x,u)  :=  h(x)  +  where  generally  :=  0  on  S  and  :=  ® 

off  S.  (V)  is  deduced  from  (IV)  plus  saddle  function  theory.  (IV)  splits  into  two 
cases:  that  of  A  continuous  is  proved  by  refining  for  the  map  (x,u)  ♦  u  the 
proof  of  (III)  sketched  below?  that  of  A  densely  defined  is  deduced  by  applying 
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the  first  to  F^(x,u)  :=  F(x,u  +  Ax)  +  ^D(Aj(x).  Here,  one  proves  as  preliminary 

facts  formulas  for  F10+,  F* $  3^f^ •  (II)  involves  two  steps:  the  case  m  »  2  is 

proved  by  refining  for  the  map  (x^,x2)  *►  x1  +  x2  the  proof  of  (III);  then  the 

continuous  case  of  (IV)  permits  replacing  f2  by  f2  □  ...  □  fm. 

Sketch  for  (III).  Observe  (Bk)*  <  Ah  always.  Let  (Bk)*(u)  <  00 .  Define  a 

l.s.c.  proper  convex  F  by  F(w,w1fw2)  ;*  g^(w  -  w^ )  +  g2(w  "  w2 ^  “  <w,z>,  for 

W  =  W-j  =  W2  =  V  x  Y,  Z  =  Z1  =  Z2  =  X  x  U,  z  =  ( 0  ,U)  ,  g1  =  ^G(B)  *  92  =  k  +  0ne 

shows  a  :=*  inf  F(w,0,0)  and  0  :=  inf  F*(0,z^,z2>  satisfy  a  =  -0,  with  inf 
W  zrz2 

in  6  attained,  if  for  p(w-j,w2)  :=  inf  F(w,w1#w2)  one  has  (a)  ot  >  -00,  (b) 

w 

(0,0)  and  dom  p  cannot  be  properly  separated,  and  (c)  3  l.s.c.  proper  convex 

p  >  p  such  that  {(Zjfz  )| p  (z  #z  )  <  y) ,  Y  e  R,  are  w.l.c.  Now  a  =  -(Bk)*(u) 

*»>  (a),  and  (ii)  <==>  (b).  For  (c),  take  p(w1#w2)  :  =  F(w  +  w1,w1,w2)  for 

fixed  w  e  dom  g-,.  Then  P(w^,w2>  =  g2(w  +  -  w2 )  -  <w«|,z>  +  c,  c  :=  g<|(w)  - 

_  _  ★  *  _ 

<w,z>,  yields  p  (z^z^)  =  g2(z)  -  <w,z>  -  c  if  (z,0)  +  (z1,z2)  =  {z ,-z)  for 

*  * 

some  z  6  Z,  and  p  =  00  otherwise.  Then  (i)  ==>  (c).  Since  F  (z,z«j,z2)  = 

h(-x2)  if  z  =  (x,u)  and  z±  «  (x^,u^)  satisfy  z  +  z-j  +  z2  =  z,  (x^-u-j)  B  G(A), 

u2  *  0,  and  F*  =  «  otherwise,  6  *  (Ah)(u).  Thus,  (1)  holds.  The  3£ 
assertions  are  proved  with  the  aid  of  (1).  For  (2),  observe  epi  Ah  lies  between 
(A  x  l)epi  h  and  its  closure,  where  I  is  the  identity  on  R;  similarly  for 
epi  A(h0+).  Using  (i),  (ii)  and  T,  G(T)  :=  G(A  x  I)  n  (epi  h  x  u  x  R)  ,  one 
proves  R(T)  =  (A  x  i)epi  h  closed.  Then,  using  (i),  (ii)  and  S,  G(S)  := 

G(  I  x  ax  I)  n  (cl  H  x  r  x  u  x  R)  r  where  H  :=  {a(  1,x,C)  |ct  >  0,  (x,£  )  B  epi  h}  , 

one  proves  R(S)  =  {(a,u,y)|a  >  0,  (u,p)  B  (A  x  i)(a  epi  h)}  U 

{ ( 0 ,u ,U) | (u ,M )  B  (A  x  i)0+epi  h}  is  closed.  Since 
J  :*  {a(1,u,p)|a  >  0,  (u,U)  e  (A  x  Depi  h}  satisfies  J  C  R(S)C  cl  J  = 

J  U  { ( 0,u,y ) | (u,p)  B  0+ ( A  x  i)epi  h} ,  R(S)  =  cl  J  follows,  whence 
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(A  x  l)0+epi  h  =  0+ { A  x  r)epi  h.  The  nontrivial  half  of  this  plus  (i 
(A  x  Depi  h  contains  no  "vertical"  line,  completing  (2). 

Details  and  related  results  will  appear  elsewhere. 


i;  imply 


r 


i 
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